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PORTABLE INTERNET-ENABLED 
CONTROLLER AND INFORMATION 
BROWSER FOR CONSUMER DEVICES 

RELATED APPLICATIONS 

This application contains subject matter related to 
co-pending U.S. patent application filed under Attorney 
Docket No. 230/055, entitled "System For Dual-display 
Interaction With Integrated Television And Internet 
Content/' filed Dec. 31, 1997, invented by the same inventor 
as the present invention, and to be assigned to the same 
assignee as the present invention. The entire original dis- 
closure of said co-pending application is herein expressly 
incorporated by reference. 

FIELD OF THE INVENTION 

The present invention relates generally to remote controls 
for controlling consumer devices, and more particularly to 
remote controls for controlling a variety of consumer 
devices from various manufacturers, and which are capable 
of using data downloaded from the internet or other data 
sources to do so. 

BACKGROUND OF THE INVENTION 

Consumers use remote controls for controlling a variety 
of devices such as TVs (televisions), radios, VCRs (video 
cassette recorders), and other home appliances. Typically, 
the remote controls use IR (infrared) communications to 
send signals to the devices to be controlled. IR communi- 
cations operate effectively only within a limited range, but 
nonetheless IR remote controls provide a great benefit for 
consumers because they allow consumers to control the 
desired devices from a couch, a chair, a bed, a desk, or some 
other relaxing remote location without having to manually 
adjust the controls on the device being controlled. 

A particular manufacturer will establish a proprietary IR 
protocol (i.e., sequence of IR commands that a device will 
recognize) for a particular device or series of devices, and 
will typically provide a proprietary remote control with the 
necessary IR commands already loaded into its memory to 
allow the consumer to control the device or devices. Proto- 
cols from one manufacturer may and usually do differ from 
protocols of other manufacturers for similar devices, 

Many types of remote controls exist, each with their own 
features, and each with their own limitations. For example, 
the most basic remote controls are dedicated to a single 
device made by a single manufacturer. These remote con- 
trols usually are fairly simple to operate, and are not 
programmable. For the same reason, however, they have 
limited functionality. Furthermore, once a consumer attains 
many devices from various manufacturers as is extremely 
common, managing the multitude of various remote controls 
for the various devices becomes very burdensome both 
physically and mentally. 

One attempt to solve the problems associated with remote 
controls dedicated to a single device led to what is com- 
monly known as "universal" remote controls. With universal 
remote controls, the IR protocols for various devices are 
typically pre-loaded into the remote control's memory. Even 
so, the consumer might have to use a trial-and-error basis to 
determine which protocol to use for a particular device. And 
it is possible that the proper protocol for the device to be 
controlled was not pre-loaded by the manufacturer of the 
remote control, because the device was too old, too new, or 
simply not popular enough as determined by the manufac- 
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turer of the remote control. In any of those cases, the 
consumer would typically be required to have the protocol 
loaded by a professional at a service location, or may even 
be required to send the remote control to the manufacturer 
5 of the remote control, and even then it may be difficult for 
the third party to correctly ascertain and load the proper 
protocol. 

Some universal remotes are "programmable" to allow 
specific IR command sequences to be associated with spe- 

10 cific physical buttons, but the remote control does not help 
the consumer associate the physical buttons with the actual 
function performed by the buttons, and the consumer is thus 
forced to memorize the function each button is programmed 
for each time the remote control is re-programmed. Custom- 

15 made labels could be used to associate the buttons with their 
functions, but that creates an additional problem of tying a 
button to a single function, thus limiting the remote control's 
functionality. Creating more buttons could solve that 
problem, but in turn would result in a consumer-unfriendly 

20 device due to its complexity. 

Another type of universal remote control has the addi- 
tional feature of allowing the consumer to load the IR 
protocols into the universal remote's memory by modem 
line or PC (personal computer). The "Program Master" by 

25 Scottsdale Technologies is of this type. The "Program Mas- 
ter" may be "programmed" by the consumer using compan- 
ion PC software to select the desired information (e.g., TV 
programs to be taped) and then initiating the downloading of 
the information into the "Program Master" by pressing a 

30 button (the only button) on the "Program Master." The 
internal clock of the "Program Master" causes the remote 
control to send appropriate IR command sequences to the 
consumer's VCR, TV, and cable receiver at the desired 
times. But once the "Program Master" is programmed, there 

35 is no way to modify the settings except by re-programming 
it using the companion PC software. 

Other universal remotes, such as the Marantz RC2000, 
have a display so the buttons could be programmed to allow 
greater functionality, and each button may correspond to 

40 several different functions depending on the "mode" setting 
of the remote. Adescription of each function associated with 
each programmed button for a given mode may appear on 
the display next to the button, but display space is typically 
limited. The Marantz RC2000, for example, has space for 

45 only five characters per button. Another remote control, the 
Lexicon SOOT, overcomes this problem to some extent, 
because it has the additional feature of a touch screen and 
graphical display 256 pixels by 128 pixels so the consumer 
may control the size and layout of the graphical buttons to 

50 some degree. However, the Lexicon SOOT retails for several 
thousand dollars, and is very limited in its use of internet 
data. For example, though the Lexicon 500T is capable of 
accessing IR protocols from the internet and downloading 
them into its memory, with companion PC software mapping 

55 the specified IR command sequences to the specified areas 
on the display screen, it cannot, like the "Program Master" 
described previously, make automated use of internet data 
such as desired TV programs to be taped. 
Some remote controls obtain more functionality and more 

60 power by communicating with the controlled devices 
through a proprietary base station. The base station is 
generally located at the site of the devices to be controlled, 
and the base station, not the remote controls, actually control 
the devices. The remote controls communicate solely with 

65 the base stations. The base stations in turn interact with the 
devices to be controlled through a variety of protocols such 
as X10 (power line communications), CEBus (common for 
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communication over a home local area network), and RS232 
(IEEE serial communication via a communication port in a 
PC). Examples of these types of remotes are the "RHOC" by 
Full House Control Corp., and the "IntelliControl" home 
automation system by Niles Audio Corp. These systems are 5 
fairly powerful, in that once the base stations are 
programmed, they can typically recognize a variety of 
industry standard protocols, so consumers could use the 
remotes to operate various devices made by various manu- 
facturers. However, the base stations are costly, and instal- 10 
lation and programming of the base stations are fairly 
complex and usually require a trained professional. 
Furthermore, the remote controls are limited in their ability 
to provide information back to the consumer, due to limited 
or total lack of display. The "RHOC," for example, though is 
equipped with some programmable physical buttons, has a 
limited display of 128x64 pixels. The Intellicontrol, avail- 
able in both a hand-held and table-top version, has no 
display at all, though the base stations associated therewith 
may have a two-character LCD (Liquid Crystal Display) 20 
and/or several LEDs (light-emitting diodes). 

Another common type of remote control is that which is 
linked to a primary display such as a TV display. Remote 
controls used to operate Web TV fit into this category. 
Though they allow a consumer to exercise parental control, 25 
monitor E-mail, place internet bookmarks, view web content 
related to real time TV events, and perform other web- 
related tasks, they affect the TV viewing screen in the 
process, thus limiting use of the screen for viewing regular 
TV-based content. Another example is Sony's S-Link con- 30 
trol bus system which allows use of the TV display in 
conjunction with the automated control of home appliances, 
such as Sony CD players and Sony TVs. All of these 
systems, however, affect the TV viewing screen because 
control information is displayed on the screen, thus impact- 35 
ing the overall view of the display. And some of the systems 
(e.g., Sony's S-link control bus system) are further limited 
because they are compatible only with proprietary devices. 

.It is also possible to use the IR communications capability 
of palm-top PCs to control consumer appliances. However, 40 
palm-top PCs are relatively costly for this type of 
application, since they are manufactured and intended to be 
used as general purpose computers. For that reason, they 
also require knowledge and use of PC operating system 
software such as MS-DOS, Windows, or other operating 45 
systems. Moreover, because the hardware is designed pri- 
marily for computer data transfer, the physical range of IR 
commands from palm-tops is limited, and the reliability of 
the execution of the commands themselves also drops as the 
distance between the remote control and the device being 50 
controlled increases. 

Thus, though there are many variations of remote controls 
available for controlling consumer devices, each has some 
drawbacks. It would be desirable to automate control of 55 
various consumer appliances made by various manufactures, 
using a single, low-cost, consumer-friendly, programmable 
remote control that does not interfere with the primary 
viewing screen, and that is capable of interacting with the 
internet or other data sources to provide a rich set of 6Q 
functionality. 

SUMMARY OF THE INVENTION 

As used in this application, "consumer" refers generally 
to any person that may use the remote control described 65 
herein, whereas ''user" is used to distinguish one particular 
consumer from other consumers generally. The use of "con- 
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sumer" versus "user" is not intended to have any substantive 
effect on this application, but is made solely to simplify 
understanding of certain parts of the application, as will 
become apparent. 

Also as used in this application, the verb "to play" is used 
generally to describe the result of a device producing its 
intended output. For example, a broadcast TV program is 
"played" on the TV; a song is played on the radio; a video 
cassette is played by a VCR, a music CD is played by a CD 
player; etc. 

Also as used in this application, the term "program" 
(when used as a noun) and the term "title" are sometimes 
used interchangeably to refer to the name of a particular 
event being played, to be played, or having been played. For 
example, a program or title may be a broadcast TV event; a 
song title or album title from a CD; an event recorded on a 
video cassette; etc. There may also be titles within titles, as 
in the case where an album title further contains individual 
song or track titles. 

Also as used in this application, the term "IR command 
sequence" is sometimes used interchangeably with the terms 
"IR command" or "IR commands." An IR command 
sequence is simply a predefined series of IR commands 
which may include only one IR command, or multiple IR 
commands to a single device, or IR commands to more than 
one device. 

The present invention relates to a remote control dedi- 
cated to the control of various consumer devices made by 
various manufacturers, and to methods of its use. It has 
programmable function keys (both physical and on-screen), 
and a graphical display used to show status and help 
information on the devices being controlled, identify the 
function associated with each key, and allow the consumer 
to browse, select, or otherwise manipulate data related to the 
control of the consumer devices. The remote control com- 
municates directly with the devices being controlled, or 
through other proprietary base stations with known proto- 
cols (e.g., XI 0 or CEBus) if necessary. 

The remote control of the present invention is relatively 
inexpensive, as compared to the cost of palm-top computers, 
or other remote control systems that require base stations, 
etc. The cost of implementing the remote control of the 
present invention is also not affected by the potential legacy 
nature of the devices being controlled, because the con- 
trolled devices do not require special hardware or software. 
All the remote control needs in order to control a device is 
the IR command sequences that the device responds to so 
that the commands may be loaded into the memory of the 
remote control for later execution. The information is gen- 
erally available from the manufacturer of the device, or from 
the internet, or from any of several other sources. 

The remote control of the present invention is also 
consumer-friendly in its appearance and ease of use. There 
are a manageable number of physical buttons, for example 
approximately eight to twelve. The drawings show a pre- 
ferred embodiment having nine physical buttons. More 
important, however, is that the actual functions performed 
by the buttons are visibly associated with the buttons 
themselves, so the consumer does not have to memorize 
such associations or rely on mnemonics printed on labels or 
limited displays. Another consumer-friendly aspect of the 
present invention is that it allows the consumer to access 
desired CDs, TV programs, satellite or cable programs, 
video cassettes, web sites, etc. through consumer-friendly 
associations (such as program name, song title, album title, 
consumer-defined sequence name, video cassette title, etc.) 
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instead of through channel, track number, device name, or 
other non-consumer-friendly associations. 

The term used in this application to describe this aspect of 
the consumer-friendly nature of the invention is "title-based 
direct access control." It is title-based because the type of 
entertainment requested is based on the title of the media 
program. It is direct access because from the consumer's 
point of view, access to the media program follows directly 
from the consumer's title-based request. The underlying 
associations (of specific IR commands to specific devices) 
that must be determined to satisfy the consumer's request is 
controlled by the remote control. Similarly, the term used in 
this application to describe the consumer-friendly nature of 
the actual descriptions displayed (such as program name, 
song title, album title, consumer-defined sequence name, 
etc.) for browsing, editing, selecting, etc., is "title-based 
descriptions.'* This is to be distinguished from information 
that is not title-based, such as a slot number in a CD tower, 
or a channel on a TV, or a track number on a CD, etc. Having 
to use information that is not title -based to access a desired 
program is not as intuitive as using title-based descriptions 
to access the program. 

On-display help also simplifies the initial device 
configuration, and status and other feedback information is 
available on-display during actual operation. All of the 
above features, and others as will be described herein, are 
designed to allow the consumer to use the remote control of 
the present invention in an efficient, powerful, and easy 
manner to control a broad range of devices from the comfort 
of a location remote to the actual devices being controlled, 
yet close enough to enjoy the entertainment or other services 
they provide. 

In addition to having some physical buttons with fixed 
functions, the remote control of the present invention may be 
programmed such that some fixed buttons and certain areas 
of the display that represent command buttons or "soft keys" 
may be defined by the consumer to control specified func- 
tions on specified devices. Passwords and filters may be 
programmed into the remote control either by integrated 
software, downloaded applets, or companion PC software, 
to limit or deny access to certain information. This may be 
useful, for example, to assist parents in controlling what 
programs or channels their children may access. 

Another important feature is that the integrated display 
allows the consumer to view associated information without 
interfering with the viewing screen of the primary display 
such as the TV. This is an improvement over many of the 
remote controls previously described herein. 

One of the most powerful aspects of the remote control of 
the present invention is its ability to interact with and gather 
data from the internet or other data sources such as a PC, and 
make use of a wide variety of data thus obtained. 
Specifically, the remote control is capable not only of 
downloading device configuration information (i.e., IR com- 
mand libraries) from the internet as existing universal 
remotes are, but is capable also of receiving other internet 
data that can be used in interacting with the controlled 
devices. For example, title-based descriptions such as TV 
schedules can be downloaded into the memory of the remote 
control, and then listed and browsed on the display of the 
remote control, while the corresponding information needed 
to associate the consumer- friendly title -based descriptions 
(e.g., program name) with the proper IR command 
sequences is downloaded therewith in a manner that does 
not need to concern the consumer. The corresponding infor- 
mation is sufficiently related to the title-based descriptions 
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such that the remote control (preferably through the use of 
integrated software) is able to determine a proper IR com- 
mand sequence to send to the device or devices being 
controlled in order to effect the playing of the program or 

5 programs selected by the consumer. The corresponding 
information may include, for example, the broadcast time, 
channel, and duration of each broadcast TV program for 
which the title-based descriptions (i.e., program name) was 
downloaded. All the consumer cares about is that the con- 

10 sumer may thereafter simply select the desired program 
from the list being browsed on the display of the remote 
control, by touching the corresponding function key, button, 
or other area of the display. 
Another example is that CD track data can be downloaded 

15 from the currently available CDDB internet database (http:// 
www.cddb.com), preventing the need for a consumer to 
manually enter the data. The consumer-friendly descriptions 
(such as title, song, etc.) may then be viewed on the display 
of the remote control and selected by the consumer without 

20 regard to the physical location of a CD in a CD tower, or the 
physical location of a particular song on a particular CD. 

Accordingly, it is an object of the present invention to 
provide an improved remote control for controlling a variety 

^ of consumer devices made by a variety of manufacturers. 
It is a further object to provide a remote control that 
allows a consumer to download data from the internet or 
other data source into the memory of the remote control for 
use in controlling the consumer devices using title-based 

3Q direct access control. 

It is a further object to provide a remote control with a 
graphical display that allows a consumer to achieve the 
above-mentioned objects without interfering with the dis- 
play screen of any of the devices being controlled or of any 

35 other devices other than the remote control itself. 

It is a further object to provide a remote control with a 
graphical display, the remote control being programmable so 
that predetermined areas of the display may be defined by 
the consumer to control specified functions on specified 

40 devices. 

It is a further object to provide improved methods of using 
a remote control to control a variety of consumer devices 
from a variety of manufacturers. 

Other objects and advantages of the present invention will 
45 become apparent from the detailed description of preferred 
embodiments which follow, when read in conjunction with 
the drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

50 FIG. 1 is a diagram showing the hierarchical relationship 
between some of the available screens in a preferred 
embodiment of the remote control of the present invention. 

FIG. 2 shows a preferred embodiment of the remote 
control with a variety of physical actuating buttons, and a 
blank display. v 

FIG. 3 shows the remote control of FIG. 2 displaying a 
preferred embodiment of the "Welcome" screen of FIG. 1. 

FIG. 4 shows the remote control of FIG. 2 displaying a 
60 preferred embodiment of the "mctures" screen of FIG. 1. 

FIG. 5 shows the remote control of FIG. 2 displaying a 
preferred embodiment of the "List Alternatives" screen of 
FIG. 1 that is used in conjunction with the "Pictures" screen 
of FIG. 1 when the remote control is in an updates-disabled 
65 mode. 

FIG. 6 shows the remote control of FIG. 2 displaying a 
preferred embodiment of the "List Alternatives" screen of 
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FIG. 1 that is used in conjunction with the "pictures" screen there is no start or end time because it is assumed to be 

of FIG. 1 when the remote control is in an updates-enabled available from a multiple-disc CD player at any time 

mode. desired. Much of the database information is derived from 

FIG. 7 shows the remote control of FIG. 2 displaying a mc interact ' but additional information may come from 

preferred embodiment of the "Browse Favorite Alterna- 5 other data sources, or even be entered by the consumer as 

lives" screen of FIG. 1 that is used in conjunction with the ^scribed herein. T*e system component also retains an 

"Pictures" screen of FIG 1 internal representation of each device being controlled, its 

type (CD playery TV^ etc.), name, and associated icon if 

FIG. 8 shows the remote control of FIG. 2 displaying a applicable. The system component also maintains a table of 

preferred embodiment of the "Music" screen of FIG. 1. ir commands for each device, along with associated data 

FIG. 9 shows the remote control of FIG. 2 displaying a such as the representation of the commands on the remote 

preferred embodiment of the "List Alternatives" screen of control's display. 

FIG. 1 that is used in conjunction with the "Music" screen The application interface component (also controlled by 

of FIG. 1. the system component) acts as a front-end for the consumer 

FIG. 10 shows the remote control of FIG. 2 displaying a 15 t0 P r °g ram and otherwise make use of the system 

preferred embodiment of the "Browse Favorite Alterna- c ° m P onent > w ^out ever having ,to understand the details of 

lives" screen of FIG. 1 that is used in conjunction with the * e ^T^' " h g f * 5° °? n * umer : 

"Music-' screen of FIG. 1 when the remote control is in an J™** 35 ^^VT^ ^ ? ] P f 

, , - , , is implemented such that a control algorithm allows the 

updates-disaoiea mode. consumer to navigate through the available screens to 

FIG. 11 shows the remote control of FIG. 2 displaying a 20 accomplish the desired title-based direct access control over 

preferred embodiment of the "Browse Favorite Alterna- consumer devices. The hierarchical relationships among 

tives" screen of FIG. 1 that is used in conjunction with the some of the available screens in a preferred embodiment of 

"Music" screen of FIG. 1 when the remote control is in an the remote control is shown in FIG. 1. These high-level 

updates-enabled mode. relationships will be described first, and the details of the 

FIG. 12 shows the remote control of FIG. 2 displaying a 25 individual screens will follow thereafter. However, to better 

preferred embodimenl of the "Current & Future Programs" understand the benefits and operation of the remote control, 

screen of FIG. 1. 11 be ne lpfcl to ^ ee P mis high-level relationship in mind 

i-t^ n . 4 j , r _ , even as the individual screens are described in detail there- 

FIG. 13 shows the remote control of FIG. 2 displaying a a ^ ef 

preferred embodiment of the "Past Programs" screen of FIG. ™* . t i ... 

J 30 I he remote control may be programmed using an lnte- 

™^ + * * * ™ grated graphical keyboard for simple tasks such as entering 

FIG. 14 shows the remote control of FIG. 2 displaying a aad modi fy ing passwords, or for more complex 

preferred embodiment of the "New Info" screen of FIG. 1. programming, but the latter is preferably done with the use 

FIG. 15 shows the remote control of FIG. 2 displaying a of companion software using an IR keyboard in conjunction 

preferred embodiment of the "Update Info" screen of FIG. 35 with the remote control's display or another display, or using 

1- PC software on a PC. For example, the functions to be 

FIG. 16 shows the remote control of FIG. 2 displaying a performed by certain buttons may be programmed by corn- 
preferred embodiment of the "Update Users" screen of FIG. panion software using an IR keyboard in conjunction with 
1. the remote contrors display or another display, or using PC 

FIG. 17 shows the remote control of FIG. 2 displaying a 4 ° softwar e on a PC, and the display would then show the 

preferred embodiment of the "New Screen Layout" screen association of physical or touch screen actuating buttons 

of FIG 1 with tne actual functions they perform, as will be described 

FIG. 18 is a high-level schematic of hardware used in a herei °' f*"™* ^ Alters may be programmed to assist 

preferred embodiment of the remote control of the present Pfrental control or other monitoring and screen layouts may 

invention 45 0 De designed. These concepts will be described herein m 

more detail. Java applets or similar predefined functions 

DETAILED DESCRIPTION mav P rov ^ e a source of filters or other information and 

may be downloaded from the internet or other data source. 

The remote control of the present invention, and methods Examples include: recommended viewing or listening lists 

of its use, will first be described in terms of its functionality 50 from well-known organizations or other critics; IR com- 

and associated software, and the hardware components will mand libraries; local TV schedules; and CD track data. The 

be described thereafter. remote control supports standard interface protocols (e.g., 

The actual software may be written in any convenient Java's Abstract Window Toolkit, Netscape's Internet Foun- 

programming language or languages, and preferably com- dation Classes, etc.), and therefore the consumer may simply 

prises an underlying system control component and an 55 select desired lists using simple third-party software, and 

application interface component. The system component then download the lists and their associated information to 

controls the execution of the actual commands necessary to the remote control's memory. 

control consumer devices. It controls the storage, access, and The software is preferably programmable by the con- 
other data management tasks necessary for proper function- sumer and presents a unified system view of various devices 
ing. Preferably, a relational database of entries is maintained, 60 being controlled. For example, there may be volume and 
each entry describing multiple features of a particular title or channel controls on one screen which control the volume of 
program, such as the time of day of its showing, which a stereo speaker connected to a TV output and the channel 
source device it is derived from (TV, satellite, etc.), which on a cable box connected to the TV input respectively. The 
artists are featured, and what category it belongs to (comedy, ease of this system contrasts with that of known universal 
drama, sports, etc.). Some of the fields are not applicable to 65 remote controls where it is necessary to first select a "stereo" 
all types of entries. For example, each track on a CD would mode, then change volume, then select "cable" mode to 
be one entry, and although a duration is associated therewith, change channel. 
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For the following descriptions, it is presumed that the 
memory of the remote control already has the information 
necessary to allow the remote control to perform the func- 
tions described. The actual methods of loading the informa- 
tion into the memory will be described subsequently. 

Turning now to FIG. 1, the "welcome" screen 15 
(described in more detail in conjunction with the description 
of FIG. 3) will appear on the display of the remote control 
10 when the remote control 10 is first turned on, and after the 
proper password or other "log-on" means (such as use of a 
"smart card") has been entered in response to an appropriate 
query if a password or other log -on means are required. This 
screen provides the consumer with a variety of first-level 
options to choose from. For example, the consumer may 
choose to be entertained by pictures, in which case the 
consumer would select the "pictures" screen 20 by depress- 
ing the appropriate physical button or display area as will be 
described shortly. If the consumer wished to be entertained 
by music, the consumer would select the "music" screen 25 
in a similar manner. 

The physical source of the entertainment (e.g., a video, 
DVD, satellite, TV broadcast, VCR, etc. for pictures, or a 
phonograph, tape player, CD player, radio, DVD, etc. for 
music) would not be of concern to the consumer. The 
consumer would simply request the entertainment type, and 
the remote control 10 would send the appropriate IR com- 
mands to whatever devices needed to be controlled to satisfy 
the consumer's request. This consumer-friendly concept of 
presenting information to the consumer in a manner related 
to how the consumer thinks (i.e., in terms of type of 
entertainment) as opposed to physical devices (such as a TV, 
cable box, tape player, etc.) is consistent with the title-based 
direct access control that is an important aspect of the 
invention. Once the type of entertainment is selected, title- 
based direct access control as previously described allows 
the consumer to select specific entertainment based on song 
title, program name, etc., and not based on such non- 
intuitive factors as channel, track, CD slot, etc. The remote 
control 10 hides the complexity of the associations formed 
by the consumer's request to the actual IR commands that 
must be executed to satisfy the request. The consumer 
controls what he or she sees or hears; the remote control 10 
controls the devices necessary to make it so. 

Both the "pictures" screen 20 and the "music" screen 25 
present the consumer with the option of selecting lower- 
level "list alternatives" screens 30a and 30b respectively or 
"browse favorite alternatives" screens 35a and 356 respec- 
tively. The "list alternatives" screens 30a and 306 provides 
the consumer with the available TV programs, CD titles or 
songs, radio broadcasts, DVD titles, or whatever other type 
of entertainment is available depending on which higher 
level screen the "list alternatives" screen depends from. On 
the "list alternatives" screens 30a and 306, the consumer 
could tag desired entries for later browsing through the 
"browse favorite alternatives" screens 35a and 356, or could 
un-tag them so that they would no longer appear on the 
"browse favorite alternatives" screens 35a and 356. 

To control devices that are not primarily for entertainment 
and would therefore not be accessible from the "pictures" 
screen 20 or from the "music" screen 25, the "other" screen 
40 is selected, which would in turn present the consumer 
with a list of further available options appropriate to the 
specific devices. Devices controlled from the "other" screen 
40 may include kitchen appliances, a web browser on an 
advanced TV, a security system, a baby monitor, etc. Though 
these devices typically do not have title-based descriptions 
associated with them to the same degree as the picture- and 
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music-producing devices do, nonetheless these devices may 
be accessed through icons or other consumer-friendly asso- 
ciations. Also, as is true even when picture- or music- 
producing devices are operating under the control of the 

5 remote control 10, IR commands may be sent to one device 
to effect a change to video output without affecting the audio 
output of another device. For example, while listening to 
music from a CD player, a request to view the security 
camera pictures on the TV will change the video output on 

g the TV, but the music will continue to play uninterrupted. 
Similarly, IR commands may be sent to one device to effect 
a change to audio output without affecting the video output 
of another device. For example, while watching TV with a 
baby sleeping in a dark room elsewhere in the house, a 

15 request to hear the audio from the baby monitor will change 
the audio output, but the video output from the TV will be 
unaffected. 

Also preferably available from the "welcome" screen 15 
is an option to access a scheduling feature of the remote, by 

2Q selecting the "scheduler" screen 45. The "scheduler" screen 
45 allows the consumer to monitor and control the current 
status of the devices, the future tasks scheduled to be 
performed by the devices, and the prior history of the tasks 
performed by the devices under the control of the remote 

25 control 10. This is done through the "current & future 
programs" screen 50 and the "past programs" screen 55. 

The "updates" screen 60 available from the "welcome" 
screen 15 allows the consumer to identify new devices to the 
remote control 10 and load the required IR commands for 

30 the new devices into the memory of the remote by accessing 
the "update system" screen 65. It also allows the consumer 
to identify new users of the remote control 10 (e.g., various 
members of the family) using the "update users" screen 70; 
load new title -based descriptions (e.g., TV schedules, CD 

35 song titles, etc.) into the memory of the remote control 10 
using the "new info" screen 75; and modify or create screen 
layouts to appear on the display of the remote control 10 
using the "new screen layout" screen 80. 

Additional relationships may exist, and additional screens 

40 may exist, though they are not shown in FIG. 1. For 
example, the consumer will preferably be able to navigate 
from a particular screen back to its parent screen, or from a 
first-level screen to any of the lower-level screens depending 
therefrom, or from a first-level screen to another first-level 

45 screen. The exact navigational algorithm used is not 
important, but what is important is that the information and 
options are presented in a consumer-friendly manner. The 
above-described relationships represent only one possible 
organization of the screens. 

so Before describing individual screens, it will be helpful to 
provide a brief description of the display area 85 and buttons 
surrounding the display area 85 as seen in FIG. 2. The 
physical display area 85 that allows the screens to be 
presented to the consumer is part of the remote control 10 

55 itself. The display is preferably an LCD and is 320 pixels by 
240 pixels (Ya VGA). It may have better resolution (i.e., 
greater than 320 pixels and/or greater than 240 pixels) or 
lesser resolution, but preferably not lesser. It may be mono- 
chrome or color, and is preferably touch sensitive. As for 

60 physical size, the drawing is not to scale, but preferably the 
remote control 10 is a hand-held size on the order of only 
several inches long by several inches wide by a few inches 
deep, such that it may be carried comfortably in one hand or 
in a shirt pocket. Various physical actuating buttons, such as 

65 sliders, push buttons, switches, touch-sensitive pads, levers, 
toggles, dials, knobs, pull buttons, a mouse, etc., are present 
on the remote control 10. The various physical actuating 
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means surround the display 85 as seen in FIG. 2. There may FIG, 1. In the context of the "pictures" screen 20 as 

be, for example, up to twenty physical buttons, or less than described in conjunction with FIG. 1, pressing the "parent 

twenty, and more preferably less than fifteen, and more screen" button 130 from the "list alternatives" screen 30a 

preferably less than twelve, and still more preferably ten or would return the consumer to the "pictures" screen 20 as 

less. 5 seen in FIG. 1. 

For example, there is an on/off toggle switch 90 connected Some physical buttons (e.g., buttons 135 and 140) may be 

to a power source by a battery terminal or an AC circuit (not programmable and may control functions such as navigation 

shown). There is also an updates button 95 (shown as a between screens, navigation within a screen, sending IR 

slider) that is used to prevent the accidental addition, commands, altering the contents of memory within the 

deletion, or modification of the remote control's 10 settings. 10 remote control 10, or any other function that may be 

If the updates button 95 is in the disable position, the applicable. Certain areas of the graphical display 85 will 

"updates" screen 60 will be inaccessible, or at least be indicate the function of a particular programmable physical 

unusable to effect any changes to the remote control's 10 key at any given time. The graphical display 85 will also 

settings. Other screens may also vary depending on the have some programmable buttons, known as "soft keys," as 

position of switch 95, and there may also be software to 15 will be described in conjunction with particular screens 

provide this type of security. shortly. 

A "help" button 100 allows the consumer to access Turning now to individual screens, FIG. 3 shows a typical 

information about the particular screen being viewed, or "welcome" screen. The different users of the remote control 

about a particular button as applied to the screen being 10 may be identified by text, graphical icons, or other images 

viewed. If the button 100 is pressed and released, help 20 including scanned photos, as shown in area 141. The current 

information related to the screen appears. This information user may be indicated by highlighting as seen in area 142, 

includes the name of the screen, the overall purpose of the or by clearing the display of all other users, or in any other 

screen, its relationship to other screens, how to access the manner. Access to the various functions is obtained from 

screen, and other helpful information. Pressing and releasing buttons 125, 130, 135, and 140, or by soft keys (not shown) 

the button 100 again returns the consumer to the screen 25 ^ tnere ^ more functions available than there are physical 

being viewed prior to pressing the help button 100. If the buttons. For example, buttons 125, 130, 135, and 140 are 

button 100 is pressed, and while being held down a second shown to transfer the consumer to the "pictures" screen 20, 

button (either physical or on-display) is pressed or otherwise the "music" screen 25, the "scheduler" screen 45, and the 

selected, help information appears for the second button. "other" screen 40 respectively, which are four of the high- 

This information includes the specific function of the button 30 level screens available as seen in FIG. 1. If button 95 is in 

as applied to the screen being viewed. To view help for updates-enabled mode, an area on the display 85 would exist 

another button, the consumer simply presses the new button to allow the consumer to transfer to the "updates" screen 60. 

instead of the second button, while still holding down the A typical "pictures" screen 20 of FIG. 1 is shown in FIG. 

help button 100. Discontinuing to press down a the help 4. Various areas on the display 85 are defined by the system 

button 100 and the button for which help is being sought, 35 component of the integrated software, and each area is used 

sends the consumer back into the general help mode, from to display specified information to the consumer. The exact 

where the consumer may simply press and release the help layout may be designed by the consumer using integrated or 

button 100 as described to return to the original screen being independent software, or the layout may be chosen from a 

viewed prior to transferring into help mode. Thus, when not set of templates provided to the consumer through the 

in help mode, pressing button 100 and either releasing it or 40 integrated software, or the layout may be fixed at the time of 

concurrently selecting another button transfers the consumer manufacture. The layouts shown in this application are 

into help mode. When in help mode, pressing and releasing illustrative only of one possible format, and it is to be 

the button 100 exits the consumer out of help mode and understood that many different layouts may be used without 

returns back to the operative screen. If the help information departing from the concepts of the present invention, 

to be displayed could not fit onto the display 85, the 45 Turning to the examples shown in FIG. 4, a first area 145 

consumer could view the remainder of the information by is used to display a description 150 of the current program 

actuating a specified button or touch screen area to scroll the being watched on the primary display such as the TV. The 

information. Buttons 90, 95, and 100 are not programmable information may include the source of the picture entertain- 

and are dedicated to the specific functions described herein. me nt (e.g., cable, VCR, satellite TV, etc.), the station or 

The other buttons, however, may be used for various func- 50 channel (e.g., Ovation, HBO, channel 2, etc.), the name of 

tions depending on the active screen and the position of the program (e.g., Miles Davis in Europe), and the start and 

button 95. end time of the picture entertainment. Other areas 155, 160, 

A slider button 105 with a spring mechanism biased to the 165, and 170, are used to indicate the current function of 

center of a slot 110 may exist for controlling functions such corresponding physical buttons 125, 130, 135, and 140 

as up and down channel. A similar slider button 115 without 55 respectively, which functions may vary according to the 

a spring mechanism is moveable within another slot 120 and specific screen presented to the consumer. On the "pictures" 

may be used for controlling volume or other functions screen 20, area 155 shows that button 125 is used as a 

whose full range may be represented by the limited physical mute/un-mute toggle button. Area 160 indicates that button 

distance available within the slot 120. Button 125 is used as 130 returns the consumer to the "welcome" screen 15, which 

a mute toggle in conjunction with some screens, and for 60 as seen in FIG. 1 would be the parent screen. Areas 165 and 

other functions in connection with other screens as described 170 indicate the functions of the programmable buttons 135 

herein. Other buttons may exist for controlling other and 140 as "best" and "prior" respectively. Pressing button 

attributes of the remote control 10 or of the devices being 135 from the "pictures" screen 20 will thus command the 

controlled. For example, button 130 is commonly, though device or devices needed in order to display the "best" 

not always, used as a "parent screen" button that allows the 65 program on the primary viewing screen (e.g, the TV screen), 

consumer to return to the screen that is logically the parent The "best" program for the current time period would have 

of the screen being viewed, as could be determined from been previously tagged from the "list alternatives" screen 
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30a or "browse favorite alternatives" screen 35a. Pressing (i.e., 8:00-10:00); Evita is available on Cable and started 

button 140 from the "pictures" screen 20 will command the prior to 8:00 (as indicated by arrow 220) and ends at 9:00, 

current device being controlled to switch to the program the at which time Terminator begins and continues (as indicated 

device was showing "prior" to the remote control 10 com- by arrow 225) past 10:00; Sports Marathon is available from 

manding the device to switch to the program then being 5 satellite TV and started before 8:00 and ends some time after 

shown. 10:00; and "Granny and Grandpa at Grand Canyon" is 

The slider button 105 is used to change channels, or available from the VCR. If the consumer touches an area 
instead of using slider 105, the consumer may enter the displaying a particular program (e.g., area 220), that pro- 
desired channel directly via a numeric keypad displayed in gram (i.e., Evita) will be tagged and added to the list of 
area 180. Slider 115 is used to control volume, if applicable. 10 favorite selections and can then later be listed and browsed 

Areas 185 and 190 are used in the "pictures'* screen 20 as from the "browse favorite alternatives" screen 35a. If the 

soft keys. Area 185 is used to allow the consumer to transfer program was already in the list, it would be removed 

from the "pictures" screen 20 to the "list alternatives" screen therefrom. Programs that are already in the favorites list are 

30a as seen in FIG. 5 and FIG. 6 and which will be described highlighted in some manner (e.g., bold, italics, underline, or 

shortly. Area 190 is used to allow the consumer to transfer 15 capital letters), so that touching the associated area would 

from the "pictures" screen 20 to the "browse favorite alter- highlight or un-highlight the program and correspondingly 

natives" screen 35a as seen in FIG. 7 and which will be add or remove the program from the list. Sources other than 

described shortly. those shown in FIG. 5 may be available, in which case the 

More specifically, by touching or otherwise selecting area consumer would be able to scroll the information on the 

185, the integrated software presents the consumer with a 2 o dis P lav 85 vertically using slider 105. Other sources of 

"list alternatives" screen 30a, of which a typical layout is picture entertainment may be a DVD device, a slide 

shown in FIG. 5 and FIG. 6. FIG. 5 shows the "list projector, a cam-corder, a closed-circuit camera, or some 

alternatives" screen 30a when the updates are disabled, as other device. Slider 115 is used to control the volume of the 

indicated by the position of button 95, while FIG. 6 shows amplifier or amplifiers responsible for the audio portion of 

the screen when the updates are enabled. Though the areas 2 s me current entertainment. 

on the "list alternatives" screen 30a are preferably defined to A line 175 is used to separate time-dependent "picture" 

occupy the same physical spaces whether the remote control entertainment from time-independent "picture" entertain- 

10 is in the updates-disabled mode (FIG. 5) or in the ment. Time time-dependent entertainment, as shown in FIG. 

updates-enabled mode (FIG. 6), the actual information dis- 5, may come from a TV broadcast, cable, satellite broadcast, 

played and/or functions performed may vary depending on 30 etc., while time-independent entertainment may come from 

the mode. The display areas may be shaded differently in the a DVD device, video tape, cam-corder, etc. A similar fine 

different modes, to alert the consumer as to whether the 175 may appear on the screens used in conjunction with the 

remote control 10 is enabled for updates or not. Similarly, "music" screen 25, though such a fine is not shown in the 

the various functions performed by the various buttons may drawings. Time-dependent music may come from a radio or 

be classified into categories such as: navigational, sending 35 satellite broadcast, for example, while time-independent 

IR commands, controlling the screen (or functions associ- entertainment may come from a CD, tape, DVD, etc. 

ated therewith), or labeling or describing the function of Areas 230 and 235 are used to indicate the functions of 

some part of the remote control 10, and these categories may buttons 125 and 140 respectively, which are to scroll the 

be immediately apparent to the consumer from the visual information on the display 85 to the right or left showing the 

appearance of the buttons. With a color display 85, this could 40 consumer which programs are available at earlier or later 

be accomplished by color-coding the various categories. times. Preferably, the time-line as displayed in area 195 

Other methods of visually alerting the consumer as to the decreases or increases in half hour increments. When the 

category that a particular button belongs to at any given time consumer has scrolled to the beginning or the end of the 

include using distinguishing text or graphics attributes such time-line (as determined by the amount of information then 

as fonts, shading, blinking, size, reverse-video, additional 45 stored in the memory of the remote control 10), the corre- 

markers, etc. sponding button 125 or 140 will become inactive, and the 

Turning to FIG. 5, area 195 indicates the date, day, and associated display area 230 or 235 will either become blank 

time-line for the programs listed, as will be explained or have an appropriate icon indicating the button is inactive, 

shortly. Areas 200, 205, 210, and 215 display icons 200a, The "parent screen" button 130 returns the consumer to 

205a, 210a, and 215a respectively that indicate the source of 50 the "pictures" screen 20, as indicated in area 240, while the 

the listed programs, while corresponding areas 2006, 2056, button 135 referred to by area 245 would allow the consumer 

2106, and 2156 indicate the actual programs being consid- to transfer directly to the "browse favorite alternatives" 

ered by the consumer. For example, icons 200a-215a could screen 35a without first having to return to the "pictures" 

represent broadcast TV, cable, satellite TV, and VCR respec- screen 20. Note here that though areas 230, 235, 240, and 

tively. To further promote the concept of title-based direct 55 245 serve the same functions as areas 155, 160, 165, and 170 

access control, it may actually be desirable to eliminate the do in the "pictures" screen 20, namely to identify the 

icons 200a-215a from the display 85, as the actual source of functions of buttons 125, 130, 135, and 140, the areas have 

the entertainment should be of little concern to the con- been identified by a different set of reference numerals to 

sumer. That would allow for more display area for other emphasize that even though the areas may occupy the same 

information. There may therefore be an option for the 60 physical space on the display 85 in both screens 20 and 35a, 

consumer to choose whether to have the sources indicated that is not necessary. For example, the text describing the 

on the "list alternatives" screen 30a. The option may be function of a button may vary in length from only a few 

available directly from the screen 30a, or it may be an option characters to several words, in which case the latter would 

determined during initial configuration and setup of the usually occupy a larger area of the display 85. 

remote control 10. 65 Turning now to FIG. 6, which shows the "list alternatives" 

The display in FIG. 5 thus indicates that Casablanca is screen 30a when the updates are enabled as indicated by the 

available on broadcast TV and covers the entire time-line position of button 95, it can be seen that the areas on this 
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screen are defined to occupy the same physical spaces as the current user, and optionally an appropriate message 

those on the screen in FIG. 5. However, that is not required, indicating that no selections had been made, would be 

and some of the information displayed and/or the functions shown. Button 130 returns the consumer to the "pictures" 

performed vary from that of FIG. 5. screen 20 as indicated by area 240, and button 135 transfers 

For instance, with updates enabled, touching area 200, 5 to the "list alternatives" screen 30a directly without requir- 

205, 210, or 215 presents the consumer with a screen full of ing the consumer to first return to the "pictures" screen 20. 

options available to control the attributes of the selected Programmable button 140 is set to "surf' as indicated by 

source. Thus, pressing or otherwise selecting area 200 area 235, and causes the display of the controlled device to 

presents the consumer with a screen to control the color, tint, cycle through all of the favorite selections, pausing on each 

balance, contrast, brightness, or other attributes of the TV 10 selection for a predetermined amount of time, which time 

display. In one embodiment, the screen presented may be a could be programmed by the consumer within a range of for 

graphical representation of the actual proprietary remote example one second to ten seconds. Slider 105 changes 

controller manufactured specifically for the device being programs between selected favorites, and does not require 

controlled. If the graphical representation could not fit explicit selection of the source device because the scheduled 

entirely within the display area 85 of the remote control 10, 15 data that is downloaded has already been associated with the 

a virtual representation could be displayed with scroll bars proper IR commands. 

to allow the consumer to access the portions of the propri- The previously described screens were related to the 

etary remote controller not then visible on the display 85. control of visual media devices. A description of the screens 

Integrated software is programmed such that the remote that are related to the control of musical or sound media 

control 10 is responsive to commands entered via the 20 devices will now follow. FIG. 8 shows a typical "music" 

graphical representation as if the commands were entered on screen 25 of FIG. 1. Similar to the "pictures" screen 20 and 

the proprietary remote controller, and thus sends the same IR to the other screens described herein, various areas on the 

command sequence to the device or devices controlled by display 85 are defined by the system component of the 

the proprietary remote controller as if the analogous com- integrated software, and each area is used to display speci- 

mands were entered directly on the proprietary remote 25 fied information to the consumer. Again, the exact layout is 

controller. not important, and the examples to be described herein are 

If a consumer wants to record a particular program illustrative of only one possible embodiment, 
without using the "scheduler" screen 45, this could be Turning to the examples shown in the drawings, and 
accomplished firom the "list alternatives" screen 30a with starting with FIG. 8, a first area 250 is used to display a 
the remote control 10 in updates-enabled mode as follows. 30 description 255 of the current title being heard. The infor- 
The consumer touches or otherwise selects the program mation will typically include the artist and title, and may 
name from the display 85, and while continuing to touch or also include other information such as the playing time, 
select the program name the consumer touches or selects a track title, device being controlled, or other consumer- 
recordable media icon (e.g., VCR or DVD). If the time to defined data that may be associated with each title through 
record coincides with the time the consumer selects the 35 the use of software. Areas 260, 265, 270 and 275 are used 
program, the appropriate IR commands are then sent to the to indicate the current function of corresponding physical 
associated device to set the device for recording the selected buttons 125, 130, 135, and 140. On the "music" screen 25, 
program. If, however, the time to record is in the future, the area 260 shows that button 125 is used to "stop" the tide then 
remote control 10 programs itself to send the appropriate IR being played. Area 265 indicates that button 130 returns the 
commands at the required time. The remote control 10 has 4 q consumer to the "welcome" screen 15, which as seen in FIG. 
an integrated real time clock for this sort of timing. 1 would be the parent screen. Areas 270 and 275 indicate the 

FIG. 6 also shows that the functions of buttons 130 and functions of the programmable buttons 135 and 140 as 
135 are different than when button 95 is in the updates- "next" and "play/pause" respectively. Pressing button 135 
disabled mode as in FIG. 5. Button 130 is used to "clear" the firom the "music" screen 20 thus sends the appropriate IR 
remote control's memory of the previously tagged or 45 commands to begin playing the next title (e.g., the next song 
selected favorites (for the day, week, etc., depending on the on a CD or DVD player, or the next CD or tape in a 
consumer's configuration of the remote control 10), as consumer-defined sequence) or switch to the next station on 
indicated by display area 240, and would also cause display a radio, etc. Button 140 from the "music" screen 25 acts as 
area 240 to then show "restore." Button 130 thus is used as a standard play/pause button on tape players. Of course, if 
a toggle to clear and restore lists of previously selected 50 these functions are not applicable to the device being 
favorite programs. Button 135 is used to tag the previously controlled, areas 270 and/or 275 would be blank or other- 
selected program as the "best" for the specified time and day. wise indicate so, or the buttons 135 and 140 would be used 
The previously marked "best" program, if any, for the for other applicable functions and those functions would be 
specified time and day would be replaced. As previously appropriately indicated in areas 270 and 275 respectively, 
described, if the consumer subsequently presses the "best" 55 Area 280 contains standard transport controls such as stop, 
button 135 from the "pictures" screen 20, the appropriate IR rewind, start of previous track, play/pause, start of next 
commands will are sent to the appropriate device so that the track, and forward. Some of the functions shown in area 280 
device switches to the program the consumer tagged as his may also be available from the physical buttons (e.g., 
or her "best" program as just described. buttons 125 and 140 in FIG. 8). 

The "browse favorite alternatives" screen 35a, which may 60 Slider 105 is used to move forward or backward through 

be accessed from either the "pictures" screen 20 or from the the available music selection as would be shown in area 250, 

"list alternatives" screen 30a as previously described, is while slider 115 controls volume as with the "pictures" 

illustrated in FIG. 7. The display 85 here shows the list of screen 20, although the specific amplifier controlled by 

programs selected by the consumer from the "list alterna- slider 115 here, as well as the source of input into the 

tives" screen 30a as previously described. If no selections 65 amplifier, may differ from the amplifier controlled by slider 

were made, the default options (as set from the "update 115 from the "pictures" screen 20 and the input source 

users" screen 70 described in connection with FIG. 16) for associated therewith. 
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Areas 285 and 290 are used in the "music" screen 25 as album, CD, etc. which contains the title. This feature is 

soft keys similar to the soft keys described in conjunction useful for the consumer to directly access a desired song 

with the "pictures" screen 20. Thus, area 285 is used to allow without the concern for who the artist is or what album the 

the consumer to transfer from the "music" screen 25 to the son g is on. In addition, a search function may be available 

"list alternatives" screen 306 as seen in FIG. 9 and which 5 to a u ow the consumer to search for a specific artist, song 

will be described shortly. Area 290 is used to allow the ^ ^um title> or other text . Text ^ entered usm 

consumer to transfer from the "music" screen 25 to the a nical ke board or an IR keyboard . 

browse favorite alternatives screen 356 as seen in FIG. 10 . , • 

and FIG. 11 and which will be described shortly. More Slldcr 115 15 ^ to conlml volumc 0D the C0Dtrolled 

specifically, by touching or otherwise selecting area 285, the device ' whilc slider 105 aUows the consumer to scroll 

integrated software presents the consumer with a "list alter- 10 mrou S h thc Ust of availabIc ^ts without actually affecting 

natives" screen 306, of which a typical layout is shown in me music bcm S heard or thc dls P lav 00 the devicc °* dcviccs 

FIG. 9, and of which the overall function of the screen 30b bein S controlled, or of any other device, 

is similar as that of the "list alternatives" screen 30a used in Tn e "parent screen" button 130 returns the consumer to 

conjunction with the "pictures" screen 20. tne "music" screen 25, as indicated in area 310. Note here 

FIG. 9 shows that screen 30b contains the available artists 15 ^at th ough areas 305, 310, 315, and 320 serve the same 

295 as well as the individual album titles 300 associated with function as areas 260, 265, 270, and 275 do in the "music" 

the artists 295. Instead of or in addition to the album titles screen 25 » namely to identify the functions of buttons 125, 

300, graphical representations of the album covers may be 130 » 135 > ^ 140 > the areas have beea identified by a 

displayed. If the consumer touches or otherwise selects an 20 different set of reference numerals to emphasize that even 

icon 302 within area 301, area 300 will change to list though the areas may occupy the same physical space on the 

individual song or track titles for the album tide associated display 85 in both screens 25 and 30b, that is not necessary, 

with icon 302. In FIG. 9, for example, selecting the upper- Referring back to FIG. 8, by touching or otherwise 

most icon 302 causes the individual song or track titles selecting area 290, the integrated software presents the 

associated with "Kind of Blue" to appear in area 301 for 25 consumer with a "browse favorite alternatives" screen 356, 

browsing and selecting. Area 295 may correspondingly of which a typical layout is shown in FIG. 10 and FIG. 11. 

change to display only the artist (Miles Davis in this FIG. 10 shows the "browse favorite alternatives" screen 356 

example) of the currently selected album title. Icons 302 when the updates are disabled, as indicated by the position 

may be graphical representations of a CD as shown, so that of button 95, while FIG. 11 shows the screen when the 

the functions associated with the icons 302 (i.e listing 30 updates are enabled. Though the areas on this screen are 

individual song titles) is intuitive. preferably defined to occupy different physical spaces 

If the consumer touches an area displaying a particular depending on whether the remote control 10 is in the 

artist (e.g., area 295a), that artist (i.e., Miles Davis) will be updates-disabled mode (FIG. 10) or in the updates-enabled 

tagged and all titles associated with the artist will be added niode (FIG, 11), the actual information displayed and/or 

to the list of favorite selections and can then later be listed 35 functions performed may be the same. The display areas 

and browsed from the "browse favorite alternatives" screen mav ^ shaded differently in the different modes, to alert the 

356. If the artist was already in the list, the titles associated consumer as to whether the remote control 10 is enabled for 

with that artist would be removed therefrom. Artists already updates or not. 

in the favorites list are highlighted in some manner (e.g., Turning to FIG. 10, the "browse favorite alternatives" 

bold, italics, underline, or capital letters), so that touching 4 q screen 356 for musical entertainment is shown with button 

the associated area would highlight or un-highlight the artist 95 in the updates-disabled mode. The majority of the display 

and correspondingly add or remove the titles associated with 85 is devoted to listing the various sequences of music 325 

the artist from the list. If the updates button 95 is enabled, as categorized by the consumer from the "list alternatives" 

the current set of selections may be stored as a sequence screen 306 as previously described. Thus, consumer-defined 

under consumer-defined labels such as "wild jazz," "party 45 music sequences such as "relaxing," "cocktail party," etc, 

music," "relaxing music," etc. will be available as seen in FIG. 10, as well as music 

Icons 303 or other text or both indicate the category of the associated with a particular artist or other source, if the 

associated album, disc, or other music sequence or collec- consumer created such a category from the "list alternatives" 

tion based upon information derived from the CDDB inter- screen 306. When the consumer touches or otherwise selects 

net database, the consumer, or another data source. 50 the name of a music sequence, details associated with that 

Button 125 is used to determine the order in which the sequence are displayed. If the consumer has not created any 

selections are displayed. For example, the selections may be selections, all default music selections would be available, 

displayed in alphabetical order by artist name, in order of The default selections may be all available CDs, or a 

music genre, by album title or by any other criteria available, particular subset defined for the particular user, for example, 

including consumer-defined criteria. Repeatedly pressing 55 Area 330 indicates the function of button 125 as "play/ 

button 125 will cycle through the available sort options. pause," which causes the currently selected sequence to 

Area 305 may indicate the current sort criteria in effect, or begin playing, or pause if it is currently playing. Area 335 

it may indicate the next available sort criteria to take effect indicates button 130 returns the consumer to the "music" 

if button 125 were pressed, as is the case in FIG. 9. In the screen. Programmable buttons 135 and 140 are labeled as 

latter case, another area of the display 85 may indicate the 60 "random" and "intros" by areas 340 and 345 respectively, 

sort criteria in effect. Button 135 is used as a "hot key" to Pressing button 135 thus plays the selected sequence one 

sort the information by "album title" (as indicated by area title at a time in random sequence, while button 140 causes 

315), or some other criterion commonly used by the the intros of each of the titles in the selected sequence to play 

consumer, even though the same criterion may be available sequentially, allowing the consumer to "surf" the available 

through the cycling of button 125. Button 140 is similarly 65 titles until a desired title is found. Pressing button 140 during 

programmed as a "hot key" to sort the information by "song "surf* mode would end the surfing and the then-selected title 

title" as indicated by area 320, regardless of the actual artist, would continue to play its full length. The exact amount of 
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time each title is played in "surf mode may be programmed 
by the consumer, or it may be predetermined. A typical 
amount of time is about five seconds. 

A soft key is displayed at area 350 with a symbol 355 or 
other text to indicate the function of the key is to cycle or 5 
repeat play of the selected sequence after it has reached an 
end. Area 350 acts as a toggle, and an indication of whether 
it is active may be established by highlighting or other 
means. Touching or otherwise selecting area 350 when it is 
active thus deactivates the cycle or repeat function, and 10 
un-highlights or otherwise indicates to the consumer that the 
function is not active. 

For each of the applications where a series of titles is 
played sequentially (i.e., an album, random list, consumer- 
defined sequence, intros, etc.) the remote control 10 deter- 15 
mines when a particular title is complete based on the track 
data or other data of the title as previously loaded into the 
remote control 10. Thus, if a first IR command is sent to play 
a first title (song) that lasts three minutes, the remote control 
should theoretically send the next IR command (for the 20 
second song to be played) three minutes after the first 
command was sent, and continue on sending the third IR 
command for the third song after a predetermined time had 
passed that is equal to the known play-time of the second 
song, etc. However, that might not accomplish the desired 25 
goal of having each song played in its entirety, because the 
start-time of each song might not occur immediately after 
the end-time of the previous song due to physical load and 
seek time of the song-playing devices. This problem is 
solved by one of the following methods. 30 

First, there may be logical cue commands in each 
sequence between the end of one song and the start of the 
next. For example, on a multiple-disc CD player, in a 
sequence which contains disc 3 track 4 followed by disc 148 35 
track 9, the remote control 10 will send a cue command 
when disc 3 track 4 finishes playing to load disc 148, and set 
the CD player in pause mode ready to play track 9. After a 
predefined delay, the remote control 10 will send a "play" 
command to start track 9. If this is followed in the sequence 4Q 
by track 10 on the same CD, the cue command in this case 
would be a null command — no additional IR commands 
need to be sent to the CD player. The insertion of cue 
commands in program sequences will normally be hidden 
from the consumer, but if the consumer wishes to customize 45 
the cue delay for some CD players (e.g., if disc loading is 
especially slow or fast for that device), the consumer may do 
so. 

The remote control 10 determines whether to send the 
next IR command, and whether a delay is needed before 50 
starting the internal timer to begin counting down the 
play-time of the next song. Factors considered are the 
physical location of the current title to the previous title, and 
the physical specifications of the devices being controlled, 
as described above, all of which are known to the remote 55 
control 10. 

More specifically, it may take some time, up to several 
seconds, for the next song to actually begin playing due to 
the mechanical load and/or seek time. Thus, if two consecu- 
tive songs are located physically on consecutive tracks of a 60 
single CD, the remote control 10 would not send a new IR 
command to begin playing the second song because the 
second song will begin play automatically in sequence 
immediately after the previous song had completed play. If, 
however, the second song was on a later track of the same 65 
CD, or a different CD in the same CD tower, or a different 
CD in a different CD player, the remote control 10 would 
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send the IR command to begin play of the second song, then 
to pause the CD player, and then would wait a predetermined 
amount of time, before sending an IR command to disengage 
pause mode and begin counting down the play-time of the 
second song. TTie predetermined time would be chosen 
conservatively to err on the side of extra delay, so that the 
remote control 10 would not consider a title to be done 
playing prior to it actually being so, which could be the case*"* 
if the timer were started prior to the actual start of the title. 
If a consumer detects that the delay is routinely too long, the 
consumer may reset the delay time to be a shorter time by 
using an option from the "updates" screen 60 or another 
screen. For media-playing devices that have the ability to 
send IR commands, a command can be sent by the device to 
the remote control 10 acknowledging the completion of a 
title, and the determination of an appropriate delay time 
would be unnecessary. 

Slider 115 is used as a volume control button as on the 
"music" screen 25, and slider 105 is used to select a 
particular sequence of those available. 

A preferred view of the "browse favorite alternatives" 
screen 35b for musical entertainment in the updates-enabled 
mode is shown in FIG. 11. In an area 360 at the top of the 
screen is a description of the sequence currently being 
updated. The description is typically supplied by the 
consumer, but may be automatically supplied by the inte- 
grated software or other software based upon how the 
sequence is selected. For example, if the consumer selects a 
sequence based on variables already known to the software, 
such as by album, CD, artist, etc., the software may provide 
the description to correspond to the known variables. In 
either case, the consumer will be able to edit the sequence 
name if desired. The main area 365 of the screen is devoted 
to listing the individual titles in the currently selected 
sequence. The tides are preferably listed in the order in 
which they will play, and the consumer may alter the order 
by touching or otherwise selecting a particular title, and then 
"dragging" the title to the desired location within the 
sequence. Slider 105 is used to scroll through the informa- 
tion on the screen. 

Button 125 is used as a "play/pause" key as indicated by 
area 370, similar to its use as described in connection with 
FIG. 10. Area 375 indicates that button 130 returns the 
consumer to the "music" version of the "list alternatives" 
screen 30b, where the consumer could then add more titles 
to the sequence if desired. To delete a title from the 
sequence, the consumer would select the title and then use 
button 135, as indicated by area 380 which displays 
"delete." Area 385 shows that button 140 is used to "save" 
the current sequence, which may have been modified due to 
deletion of titles, and/or rearranging of titles as explained. A 
pop-up dialog box at that time would provide the consumer 
the opportunity to change the description of the sequence if 
so desired. 

"Scheduler" screen 45 is not shown in the drawings, but 
typically will be a simple screen allowing the consumer to 
select a lower-level screen, which in FIG. 1 are shown to be 
the "current & future programs" screen 50 and the "past 
programs" screen 55. FIG. 12 shows a typical "current & 
future programs" screen. This screen allows a particular user 
to control the programs and/or sources available to them and 
other users. Depending on the user currently "signed on," (as 
will be described herein) the particular users* settings that 
can be modified may differ. For example, a parent with a 
"supervisor" password may have access to all users* 
settings, while a child may have access only to their own 
settings. The particular user whose settings are being 
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updated is indicated by highlighting (as seen in FIG. 12 at listening schedules which may have been recently obtained 

390) or other means. from the internet and which reflect the next day's or next 

This screen allows the sources, and/or individual pro- week's programming. Key 405 would be used to update 

grams from those sources to be made unavailable to speci- information regarding the available CD collection. For 

fied users, as seen by the function of buttons 125 and 130 as 5 example the consumer may have purchased new CDs, or 

displayed on the display 85. Thus, a parent could set a amoved some others from the CD player and the relevant 

child's settings such that the child could not access the TV formation wouW need to be loaded into the remote contro 

;~ - • * j , . . u i c 10 so the actual CDs correspond to what the remote control 

during certain time periods; or not access certain channels of 1ft . . A . .. ^ 

4l _ JZr r ' . . 10 has stored in its memory. 

the TV; or not access certain programs within a certain t-u« «, j < t *m • u • ™- i« ^ . 

, i e ,i rm / ♦ n • clu i- •* u * m The update system screen 65 is shown in FIG. 15. This 

channel of the TV, etc. Programrmng of these ^ io ^ ^ ^ ^ fof y 

has been referred to herein as filters. The purpose of the optior / to update stcm variablcs> For £ { if thc 

filters is simply to limit or deny access to certain entertain- consumcr changcs mtcrnet scrvice providcrs £ SPs)> thc 

ment or control of other devices as seen fit by the user with requirements for accessing the ISP can be updated using soft 

the authority to do so. Thus, a parent could create filters that key 410 labeled "new/changed information source." 

cause only a predetermined subset of the title-based descrip- 15 similarly, if the access method is changed (e.g., from one of 

tions in the memory of the remote control 10 to be displayed USB, IrDA, RS232, modem, etc. to another of USB, IrDA, 

to a particular user. RS232, modem, etc.), this information may be communi- 

Another feature that may be available is the use of a time cated t0 tne remote control 10 by a soft key 415 labeled 

budget for certain users. Thus, a parent could limit the total "new/changed connection." Another available option is to 

TV time of a child using this feature. This could also be 20 identify a new device to or delete an old device from the 

accomplished by use of a "smart card" which the parent can devices known to the remote control 10. This is accom- 

create with predefined amounts of time, and which the fr ° m a soft kev 4 ?° U ^ "new/changed device " 

remote control 10 could then update each time the card was * or f new device the IR command library for the 

used. The smart card may also have identifying information f nTfT ru ^ ™™*y of the remote control 

encoded thereon such that the remote control 10 could 25 10 * If thc fh ^ ary 18 ™ X ™> ^ example d the library 

-j 4t _ t t , ( is associated with the exact make and model of the device, 

identify the user Of course, the remote control 10 may stall then the identified ub A , be loaded If 

require the user to enter a password to gain access to its h(JW ft ^ ^ ^ tQ be loaded is 

activating features, m order to prevent an unauthorized user ^ ub ^ fc ^ , oad 

from using the smart card. Button 140 returns the consumer ^ ^ d ^ ^ ^ remote ^ ^ tf ^ 

to the welcome screen 15. ,., +u 4l « m.. , 4 . . , 

library was the correct library. This may have to be repeated 

The "past programs" screen 55 is shown in FIG. 13. The unt i] the proper library is verified, 

screen layout is similar to that of the "current & future Id me case where it is uncertain if the library to be loaded 

programs screen 50 as seen in FIG. 12, but that is not fa tDe Ub the consumer may have t0 load test 

required. The purpose of this screen 55 is to allow review of 35 unload> load> test , unload) etc repeatedly until me 

what a particular user has used the remote control 10 for. The hbr&ry is identified Gr to avoid this, the consumer may load 

integrated software tracks the specific IR commands sent by multi , e Hbraries at onc6j md ±eQ ^ me rcmote conlrol 

the remote control 10, and associates the commands with a 10 to cyck the selected set of libraries> testi eat± 

particular user based on the password or other means used Ubrary ^ ^ proper lib & detennined If me device 

to activate the remote control prior to the programs being ^ has tne capability of sending IR communications, and the 

selected that resulted in the IR commands being sent. remote contfol 10 has the abiHty %Q receive , R 

Button 140 returns the consumer to "welcome" screen 15 communications, the device could signal the remote control 

as in the "current & future programs" screen 50. The other 10 once the proper library has been identified, and the 

buttons, however, provide new functions. Pressing button remote control 10 could then cease the testing cycle. The 

125 results in a display of which programs the particular user 45 consumer could then purge the unnecessary IR command 

being reviewed has seen. Again, the user being reviewed libraries from the memory of the remote control 10. If, 

may be indicated by highlighting as seen in area 395, or by however, the device does not have the ability to send IR 

other means. The programs are preferably sorted in chro- communications, or if the remote control 10 does not have 

nological order, with the most recently viewed or listened to the ability to receive IR communications, then the consumer 

program appearing on top. However, any sort order may be 50 may be required to monitor the testing cycle to manually halt 

used, and options to select the sort order may be available. the cycle once the proper library is determined, and to 

Button 130 is a "hot key" to provide the summary sorted by thereafter program the remote control 10 to associate the 

source, as just described. Button 135 allows review of the identified library with the device and optionally to purge the 

time budget of the user being reviewed, and may be used in other libraries that were being tested. Even in that situation, 

conjunction with a "smart" card if the smart card feature is 55 however, there is an advantage to being able to use the 

available, so the reviewing person (usually a parent) would remote control 10 to cycle automatically through libraries 

have extra monitoring means to ensure the reviewed users and test them in an attempt to find a desired library to operate 

(usually the kids) are not abusing their privileges. the device. The consumer has only to issue one command 

The "updates" screen 60 is not shown in the drawings, but (i.e., a "cycle and test" command), instead of several corn- 
similar to the "scheduler" screen 45, this screen 60 will 60 mands (i.e., "test library #1," "test library #2," "test library 
typically just provide the consumer with the options of #3," . . . "test library n."). The consumer is thus free to watch 
selecting the available lower-level screens, which as seen in a program uninterrupted, and will be interrupted only when 
FIG. 1 would be screens 75, 65, 70, and 80. The "new info" the remote control finds a desired library, or otherwise 
screen 75 is shown in FIG. 14. This screen simply provides indicates that none of the available libraries can operate the 
soft keys 400 and 405 which allow the consumer to update 65 device. 

certain information then known to the remote control 10. So cycling through a series of IR command libraries after 

Key 400 would be used to download new viewing or loading the series of libraries into the memory of the remote 
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control 10 is accomplished by actuating only one button on 
the remote control 10, which causes the cycling to begin. 
The cycling then automatically occurs, and comprises 
selecting a library, sending an IR command associated with 
the selected library from the remote control 10 to the device, 
determining if the device responded to the IR command sent, 
and then continuing on to test the next library in the same 
manner (or automatically stopping the cycle if the device 
communicates back to the remote control 10 to indicate that 
the device recognized the command sent). The consumer 
may hit a "stop" button on the remote control 10 to end the 
cycling, for example when it is determined that the proper 
library has been found, or for any other reason. 

Other options available from the "update system" screen 
65 could be an option to allow the current settings (for all 
users) to be saved onto an alternate storage device, such as 
another remote control, a PC's hard disk, a tape or floppy 
disk backup, etc., or an option to access information about 
the technical specifications of the device, with phone num- 
bers of the manufacturer or other available help sources. 
Other miscellaneous options related to the overall mainte- 
nance and programming of the remote control 10 could also 
be available from this or other screens. 

Both the "new info" screen 75 as shown in FIG. 14 and 
the "update system" screen 65 as shown in FIG. 15 may vary 
in both appearance as well as in functionality depending on 
whether the remote control 10 is being used in conjunction 
with a PC to access an outside data source. For example, the 
"new/changed information source" soft key 410 may not be 
applicable if information was being loaded from the PC, 
even though the source of the information downloaded to the 
PC may have changed. 

FIG. 16 shows the "update users" screen 70, which is 
where all of the settings are made for each individual user's 
profile or configuration. Thus, each user may select their 
screen name, the associated icon or image, which pictures 
and music selections they would prefer to exclude from 
those available, and to some degree the screen layouts that 
they will see. The name and icons are simply used to identify 
the user on the other screens, so it is clear which user is 
currently signed on, or which user is being reviewed, 
whichever the case may be. The pictures and music selec- 
tions may be used, for example, if a child does not want to 
have to sift through mom and dad's music but would prefer 
instead to only sift through his or her own collection. In that 
case, the child could set their default to not show mom and 
dad's music when listing available music, so there would be 
less information to browse through. 

The screen layouts option allows the user to select from 
a predefined set of possible layouts that might be more 
visually pleasing or easier to use. For example there may be 
one layout with cartoon icons suitable for children, another 
with the minimum number of on-screen buttons for those 
who prefer less clutter, another with designer patterns, etc. 
In addition, within a predefined layout each user may 
customize the screen layouts using available field- 
manipulation commands, as will be described shortly. Other 
options set here, though not shown in FIG. 16, include the 
user's password and possibly the user's security level, which 
would determine which other profiles the user could access 
and/or update. 

Another available option from the "updates" screen 60 is 
the "new screen layout" screen 80, as is seen in FIG. 17, and 
the screen is preferably shaded, as seen, to indicate that the 
information being viewed is not available for actual use, but 
is instead available only for changing its layout. The screen 
shown in FIG. 17 is the "pictures" screen 20 as seen in FIG. 
4. 
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A particular area on the screen may have a button added 
or deleted, moved to another area, sized, or edited. The 
various functions could be accomplished by touching or 
otherwise selecting the area, then holding down the appro- 

5 priate physical button 125, 130, 135, or 140 while continu- 
ing to touch the area. The functions of buttons 125, 130, 135, 
and 140 in this context are not displayed, as doing so would 
impede the view of the current layout being updated. It may 
be desirable, however, to display the associated functions in 

10 a very small font just above the buttons, such that their 
function is apparent and the screen layout is only minimally 
impaired. Otherwise, the consumer could view the informa- 
tion from a help screen (available by using button 100), or 
simply know the functions of the buttons from reading an 

15 associated manual or becoming accustomed to their use in 
this context. 

To add an area on the screen layout, the consumer selects 
the area, and a pop-up menu appears with various types of 
shapes, etc to choose from. If the area already has an object 

20 associated with it, then pressing the add/delete button would 
delete the object, (possibly after confirmation) associated 
with the area. To move an object on the layout, it could be 
touched and "dragged," or it could be moved by selecting a 
final destination. Sizing an object may occur similarly by 

25 touching and dragging (away or towards the center of the 
object to increase or decrease its size respectively), or by 
otherwise selecting a final desired size. Editing an object 
causes a pop-up menu to appear with the available options 
to edit. Options include the name, the image, the function 

30 (label, navigation, sending IR commands, edit, etc.), a copy 
and a paste option, and save and exit options. 

Another possible method of creating screen layouts is 
through the use of the internet HTML (Hypertext Markup 
Language). The remote control 10 will be compatible with 

35 and understand most and preferably all of the constructs of 
HTML, which is used to define the layout of web pages. It 
is therefore possible, when programming with companion 
PC software, to use one of the many available web page 
design tools to design a customized set of screens. However, 

40 the HTML format will only be used for defining the look of 
the screens. Other programming concepts would be needed 
to associate functionality with the various HTML custom- 
ized screen areas. 

45 To get to a particular screen layout to update, the con- 
sumer could navigate to the desired screen and press a hot 
key on the screen to switch to screen-update mode (though 
such a hot key is not shown in the drawings). Or a selection 
of available screens may be presented to the consumer from 

50 the "new screen layout" screen 80. 

Turning now to the "other" screen 40 (which is not shown 
in the drawings), this screen 40 provides other functions not 
previously discussed. For example, control of kitchen 
appliances, a web browser on an advanced TV, a security 

55 system, a baby monitor, etc. may be accomplished through 
options presented on the "other" screen 40. Another option 
could be a pre-loaded list of popular web sites from which 
useful information could be downloaded. Control of other 
consumer devices may be performed from the "other" screen 

60 40 as well. An option may be available to "close down" all 
devices, such that selecting the option causes all devices 
under control of the remote control 10 to power-down. The 
preceding examples are only illustrative, and by no means 
limiting of the types of function that could be available from 

6S the "other" screen. 

A preferred embodiment of the remote control 10 of the 
present invention has just been described in relation to how 
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the remote control 10 would be used to control visual media, 
sound media, and other devices. It is to be understood for 
these descriptions, that the specific screen layouts, naviga- 
tional algorithms, and described functions of the buttons, 
may be modified greatly without departing from the con- 
cepts of the present invention. 

Several examples have been provided of the type of data 
from the internet or other data source that could be loaded 
into the remote control 10. Some of those examples will be 
discussed in more detail here, along with other examples, as 
this is an important aspect of the invention. One application 
would allow the consumer to load TV schedules appropriate 
to their area into the remote control 10, and then list and 
browse the schedules. One person could be browsing the 
schedule of programs available on alternative channels, 
without disturbing the view of others who are watching the 
primary screen such as the TV. If an alternative program is 
more appealing, it could be selected from the remote control 
10 by simply touching the particular button corresponding to 
that program. The schedules may be provided by 
subscription, or by an arrangement between the vendor of 
the remote control 10 and third parties supplying the infor- 
mation. A similar technique is used to select a program to be 
recorded on a VCR. 

Another application would allow the consumer to load 
information relating to the consumer's entire CD collection 
into the remote control 10. Once the CDs are catalogued and 
then stored in a multi-disc CD player (units holding up to 
200 CDs or more are common), the consumer could choose 
which music to play using only title -based direct access 
control. That is, the consumer could select by album or song 
title rather than by track numbers or slot numbers. And as 
previously described, individual sequences may be defined 
for specific moods. This method of browsing and selecting 
music differs from that of the currently available Sony S-link 
control bus system, because unlike the Sony system, the 
present invention allows the selection and display of titles on 
CD players from multiple manufacturers and does not 
require the use of a TV at all, let alone a specially-equipped 
Sony TV Furthermore, the process of entering the descrip- 
tive data for the CD collection is greatly simplified, because 
the data can be loaded from the internet. Or the data can be 
loaded from a PC or other data source. A device (such as a 
PC) with a digital CD drive (CD-ROM, CD-R, CD-RW, or 
any type of software-controllable CD drive) could gather the 
information needed to load into the memory of the remote 
control 10. In one embodiment, the remote control 10 has an 
integrated CD drive, and in another the remote control 10 
has hardware to connect to a CD drive. In each case, the CD 
drive may be compatible with standard CD sizes, or smaller 
or larger CDs, or any combination thereof. In any of the 
cases described, the consumer does not have to individually 
enter the information for each CD, but instead is able to use 
an automated device such as a CD drive to gather the 
information, and then use the information to gather associ- 
ated information and title-based descriptions from an outside 
data source such as the internet. The CD information read by 
the CD drive, and the associated information and title-based 
descriptions from the outside data source, may then be 
loaded into the memory of the remote control. A preferred 
method includes the consumer placing a CD in the CD drive 
of a PC (or of the remote control 10, or of any CD drive 
accessible by the remote control 10), such that the track data 
can be appropriately read. Software can derive the track 
name, title, artist, playing time, and other information from 
the internet CDDB database, and the data can then be 
downloaded into the remote control 10. The consumer 
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would place the CD in the CD player, and inform the 
software of the location of the CD within the CD player. 
When the consumer later selects or otherwise works with 
titles from a particular CD by browsing information on the 
display 85 of the remote control 10, the necessary IR 
commands are already associated with any tasks the con- 
sumer would want to perform that involve the particular 
titles. 

Another example of the type of data that the remote 
control 10 could download is of course the IR libraries or 
protocols for specified devices. Though the remote control 
10 will preferably be pre-loaded with a significant set of IR 
libraries for known manufacturers and devices, there may be 
some devices for which the protocols are not pre-loaded. In 
the latter case, the data (IR protocol) for a specific device 
could be loaded from the internet or other data source. 

Reviews and other details of particular movies may be 
loaded into the remote control, and are currently available at 
internet sites such as the Internet Movie Database (http:// 
www.us.imdb.com). "Play lists" may be compiled by friends,, 
family members, or other third parties such as movie critics, 
comprising title-based descriptions such as recommended 
viewing or listening, and the remote control 10 may be 
programmed to load the playlists into its memory such that 
the consumer may list, browse, edit, and select programs 
from the playlists. 

The examples provided herein are illustrative of the types 
of information that can be loaded into the memory of the 
remote control 10, but by no means are the examples 
provided to be exclusive. The important concept is that data 
related to the control of consumer devices may be obtained 
from an independent data source and loaded into the remote 
control 10 such that the remote control 10 can control the 
consumer devices in a manner described herein as title- 
based direct access control. Software, which may be PC 
software, integrated software, or some other software, con- 
trols the loading of the data into the memory of the remote 
control 10. The software also controls the associations 
needed to present a unified set of screens to the consumer 
which associate the appropriate layouts with the appropriate 
physical and on^reen actuating buttons such that the 
consumer may exercise title-based direct access control of 
the consumer devices. The software further controls the 
associations needed between the commands requested by the 
consumer (e.g., by pressing buttons or other areas of the 
display 85) and the actual IR commands corresponding to 
those requests. For example, slider 115 may send IR com- 
mands to the amplifier of one device when the displayed 
screen is the "pictures" screen 20, but it may send IR 
commands to the amplifier of another device when the 
displayed screen is the "music" screen 25. The underlying 
associations are all controlled by the software (and/or 
hardware), such that the consumer is free to exercise title- 
based direct access control. 

The prior description dealt mainly with the methods of 
using the remote control 10, as well as some of the software 
aspects of the remote control. The following description will 
focus on the hardware aspects of the present invention, some 
of which may have already been briefly described. 

FIG. 18 is a high-level schematic of hardware used in a 
preferred embodiment of the remote control 10 of the 
present invention. The hardware is in the same class and 
similar to that of known personal data organizers such as the 
Palm Pilot by US Robotics. A data bus 595 connects an RTC 
(real-time clock) 600, CPU (Central Processing Unit) 605, 
memory chips 610, 615, 620, and 625, Input/Output Appli- 
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cation Specific Integrated Circuit (10 -ASIC) 630, and USB 
(Universal Serial Bus) port 635. Various other communica- 
tions ports 640, 645, 650, and 655, are connected to the 
IO-ASIC 630 as will be described shortly. The remote 
control has a touch screen 660 and LCD 665 as previously 
described, and may also have a speaker 670 for sound. The 
power source 672 is shown preferably as four AA batteries 
or a 6V DC from an external PSU (power source unit). 

The CPU 605 is preferably the Mitsubishi 
M32000D4AFP, but that is not required. The RTC 600 is 
preferably a crystal-based clock, and is used to synchronize 
IR commands with the proper TV broadcast, radio 
broadcast, satellite broadcast, or other signals to satisfy the 
consumer's requests. In addition, the RTC 600 is used to 
determine when a particular title or titles from a CD have 
completed based on the play-time associated with the title or 
titles. 

Memory 610 is a boot ROM for holding the system 
software, which includes the system control component and 
may include some or all of the application interface 
component, though the application interface component is 
preferably stored in the flash ROM 625. Flash ROM 625 
also stores downloaded information such as TV schedules, 
CD track data, etc. The flash ROM 625 is preferably at least 
2-8 Megabytes. Pre-loaded IR command libraries are pref- 
erably stored in the flash ROM 625. Memory chips 615 and 
625 are RAM chips used for working memory. Memory 615 
is shown as a DRAM, and is preferably at least 4 megabytes. 
Memory 620 is shown as an SRAM and is preferably at least 
256-512 Kilobytes. The SRAM 620 is optional, but if it is 
present it may be used for certain operations that may 
require faster speed than other operations. 

The IO-ASIC 630 is preferably a Mitsubishi M65455FP, 
but that is not required. It comprises a UART (Universal 
Asynchronous Transmitter and Receiver) 675, a 32-channel 
ICU (Interrupt Controller Unit) 680, a 2-bank DRAMC 
(DRAM controller) 685, an 8-channel CSC (Chip Select 
Controller) 690, an LCD controller 695, its own 16-bit 
4-channel timer 700, and a PWM (Pulse Width Modulator) 
705. The UART 675 is used to transmit data through port 
640 which is a control IR port, and to transmit and receive 
data through ports 645, 650, and 655. Control IR port 640 or 
its equivalent is essential because the data sent through 
control IR port 640 are the IR commands to control devices. 
The other ports (635, 645, 650, and 655) are optional, but at 
least one is required in order for the remote control 10 to 
connect to an outside data source such as the internet. Port 
645 is an IrDA (Infrared Data Association) port used for 
wireless communication. (There may also be additional 
hardware for RF (radio frequency) communications, though 
such hardware is not shown.) Port 650 is an RS232 port for 
connection to a standard serial port of a PC Port 655 is a 
modem port for connection directly to telephone lines. Port 
635 is a USB port which is an industry standard port for 
"plug and play" connection to PCs. The USB port 635 is 
connected directly to bus 595 and can transfer data at a rate 
of up to 4 megabytes per second, much faster than the UART 
675 which can typically transfer data at a rate of only up to 
about 115 kilobytes per second. The ports other than the 
USB port 635 are connected to bus 595 only through the 
UART 675 in the IO-ASIC 630. 

The ICU 680 coordinates and controls requests to the 
CPU 605 from various input and output devices either 
integrated with the remote control 10 or connected thereto. 
The DRAMC 685 controls access to the DRAM 615, and the 
CSC 690 processes the consumer's touch screen 660 
requests, which first pass through a 10-bit analog-to-digital 
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converter 710. The CSC 690 also interacts with the flash 
ROM 625, the modem port 655, and other components, and 
serves a fairly general control function in the IO subsystem. 
The LCD controller 695 controls what is displayed on the 

5 LCD display 665 (in FIG. 18 LCD 665 represents the 
display 85 seen in the other drawings). The timer 700 is used 
for short timing (on the order of milliseconds) within the 
IO-ASIC 630 (such as repeated checking of interface status, 
refreshing the LCD display 665, etc.). The PWM 705 sends 

10 digital signals to a digital to analog amplifier 715 which 
passes the signal to speaker 670. The speaker 670 may be 
used to alert the consumer of errors on input when 
programming, or attempted unauthorized access to certain 
data, or a pending request, or any other event through the use 

15 of various beeping or buzzing sounds of various frequencies, 
volumes, and/or durations. Or the speaker 670 may be used 
for voice sound that states title-based descriptions so that 
seeing-impaired persons may benefit from the present inven- 
tion. The voice sounds may be loaded from an outside data. 

20 source, such as the internet, or there may be suitable 
text-to-voice software for creating the voice data from the 
title-based descriptions. 

Thus, the remote control 10 has hardware for generating 
IR commands suitable for controlling consumer devices, and 

25 may also have hardware for receiving IR communications 
(e.g., through IrDA port 645). It may have hardware for 
higher-bandwidth wireless data communications such as fast 
IrDA, and may also have physical connections for wired 
data communications, such as a modem (port 655) for direct 

30 phone connection, or wired connections (port 635 or 650) to 
a PC. There are large amounts of non-volatile memory (flash 
ROM 625, preferably at least 1 megabyte, and more pref- 
erably at least 2 megabytes) for the storage of data relevant 
to the operation of the consumer devices to be controlled, 

35 and large amounts of working memory (DRAM 615 and 
SRAM 620) as well. The remote control 10 will be powered 
preferably by batteries (672), though it is possible to provide 
another DC power source or even an AC power source. The 
batteries may be rechargeable, and may be associated with 

40 a table-top docking station which provides power for 
recharging or table-top use, and which may also provide the 
various connections needed for communications as 
described herein (e.g., modem for direct internet connection 
and intelligent telephony control, connections with a home 

45 PC, etc.). The docking station may also include a CD drive 
for reading CD track data, and/or a printer for printing 
information from the remote control's memory such as user 
configuration files, information related to past programs 
viewed by particular users, help information, or any other 

50 information. 

As described herein, the remote control 10 may connect 
to the internet or other data source directly or by a home PC. 
The connection may be through wired communications or 
by wireless. Wired connections may be made through a USB 

55 connection or other serial connection to a PC or other 
hardware device, or through a standard connection to tele- 
phone lines. Wireless communications may be through the 
use of IrDA protocols or other wireless links (e.g., RF with 
the use of additional hardware) to a PC or the phone lines. 

60 In the case of a direct link, the remote control 10 will 
either have a standard telephone connection point with an 
internal modem, or else hardware and software enabling 
wireless communication with a standard domestic wireless 
phone base, such that a telephone connection could be made 

65 between the remote control 10 and the internet. The source 
connected to may be a standard ISP company, in which case 
the remote control would contain all of the necessary 
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internet protocols and web client technology to be able to 
send "http" requests and receive data or download program 
"applets" in response. The source connected to may instead 
be dedicated solely to serving remote controls 10 of the 
present invention. In that case, the consumer would not have 
to have access to a pre-existing ISP account, as the necessary 
data for initial setup and configuration of the remote control 
10 for a particular set of devices could be performed simply 
by a phone connection, with companion server software and 
server hardware at a remote location providing all the 
necessary access to third party internet locations. 

With connection via a home PC, companion PC software 
could use a pre-existing service with an ISP to download all 
relevant data, for subsequent transfer to the remote control 
10. If the consumer does not have an ISP account, but the PC 
is equipped with a modem, the same companion remote 
server may be used as for the case described where there is 
a direct telephone connection from the remote control 10. 
When used in conjunction with a PC, the remote control 10 
would not require all of the communications hardware and 
software herein described, and hence an embodiment with- 
out all or part of the communications hardware and/or 
software may provide an attractive lower-cost alternative for 
consumers who already own a PC. For those without a PC, 
the embodiment of the remote control 10 with internet 
connection hardware and software built in might be more 
expensive than the embodiment without it, but still it would 
likely be much less expensive than purchasing a PC and 
would avoid the complexities associated with PCs which 
may not be necessary for operation of the remote control 10. 

As noted herein, the remote control 10 may have an 
integrated software keyboard or other input means, but it 
might be desirable for certain programming tasks to be 
performed using companion software with an IR keyboard 
in conjunction with the remote control's display or another 
display, or using PC software on a PC. That is because the 
typical PC display would provide a larger viewing area than 
that on the remote control 10 itself, and the keyboard and 
mouse may facilitate input of data for many consumers that 
are used to such input means. Even without a companion PC 
and companion software, programming of the remote con- 
trol 10 may be simplified through the use of an IR keyboard. 

The remote control 10 may also have an integrated CD 
drive, but if it does not, a separate CD drive would be needed 
for cataloguing the consumer's CD collection. That is 
because to free the consumer from having to enter in the 
details of every CD in a collection, the track data from the 
CD must be read from a software-controllable CD drive so 
that the data can be associated with the corresponding 
internet CDDB data. As previously stated, even if the CD 
drive is not integrated with the remote control 10, the CD 
drive may nonetheless be accessible by the remote control 
10. 

To catalog a CD for future control by the remote control 
10, the consumer would place the CD in a CD drive. 
Software would then determine the track numbers and 
lengths, and correlate the information with the data from the 
CDDB or other data source. The consumer would place the 
CD in the CD player in the slot where the software expects 
the CD to be, and the CD data would be transferred to the 
remote control 10 using wired or wireless communications 
as described herein. The remote control 10 would then be 
prepared to display song titles, album titles, artists, track 
data, etc., and allow the same to be listed, browsed and/or 
selected for play. 

While certain embodiments are illustrated in the drawings 
and have just been described herein, it will be apparent to 



those skilled in the art that many modifications can be made 
to the embodiments without departing from the inventive 
concepts described. Accordingly, the invention is not to be 
restricted except by the claims which follow. 
What is claimed is: 

1. A method of limiting a user's access to programs that 
are played by a device that responds to infrared (IR) cqm r 
mands comprising the steps of: 

providing a programmable remote control capable of 
sending IR commands that control the device, the 
remote control having a memory, a graphical display, 
and integrated software that is programmed to present 
to the user on the graphical display information that 
activates the remote control for use by the user; 
loading title-based descriptions into the memory of the 

remote control; 
programming the remote control to determine the identity 
of the user based upon predetermined information 
entered into the memory of the remote control to gain 
access to the information that activates the remote 
control for use by the user; and 
programming the remote control to present to the user on 
the graphical display a predetermined subset of the 
title-based descriptions, said subset being determined 
based upon the identity of the user. 

2. The method of claim 1, wherein the identity of the user 
is displayed on the graphical display. 

3. The method of claim 2, wherein the identity of the user 
is displayed in the form of a scanned image. 

4. The method of claim 1 wherein the title-based descrip- 
tions are loaded into the memory of the remote control from 
the internet. 

5. The method of claim 4 wherein the device is a TV and 
the title -based descriptions comprise broadcast TV program 
names and corresponding broadcast times of programs asso- 
ciated with the program names. 

6. The method of claim 4 wherein the device is a satellite 
receiver and the title-based descriptions comprise satellite 

40 TV program names and corresponding satellite transmission 
times of programs associated with the program names. 

7. The method of claim 4 wherein the device is a cable TV 
box and the title-based descriptions comprise cable TV 
program names and corresponding cable transmission times 

45 of programs associated with the program names. 

8. The method of claim 4 wherein the device is a CD 
player and the title-based descriptions comprise the title of 
a music CD album, the title of each song on the CD album, 
and the corresponding duration of each song title. 

9. The method of claim 4 further comprising the step of 
programming the remote control to allow a second user to 
determine the programs played in response to IR commands 
sent by the remote control while the remote control was 
activated for use by the first user. 

10. A programmable remote control for controlling a 
plurality of consumer devices that respond to infrared (IR) 
commands, the remote control comprising: 

hardware capable of sending IR commands; 
an integrated graphical display; 

integrated software programmed to present a set of 
screens on the graphical display for navigating through 
available options; 
at least one port for communicating with an outside data 

source; 
a memory; and 
at least two physical buttons; 
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wherein the integrated software is further programmed to 
present a graphical representation of a proprietary 
remote controller used to control at least one of the 
plurality of consumer devices, said representation 
being responsive to commands as if the commands 
were entered on the proprietary remote controller, 
causing the remote control to send the same IR com- 
mand sequence to the at least one of the plurality of 
devices as if the analogous commands were entered 
directly on the proprietary remote controller. 
U. A method of cycling through a series of IR (infrared) 
command libraries to determine if any library in the series 
contains commands to operate a device, comprising the 
steps of: 

loading the series of libraries into the memory of a remote 
control; 

actuating a button on the remote control to cause the 
cycling to begin, wherein the cycling comprises select- 
ing a library from the series of libraries, sending an IR 
command associated with the selected library from the 
remote control to the device, and determining if the 
device responded to the IR command associated with 
the selected library. 
12, The method of claim 11 further comprising the step of 

actuating a button on the remote control to cause the cycling 

to end. 
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13. The method of claim 11 further comprising the step of 
ending the cycling based on a communication from the 
device to the remote control indicating that the IR command 
sent was recognized by the device. 

14. A programmable remote control for controlling a 
plurality of consumer devices that respond to infrared (IR) 
commands,-the remote -control comprising: 

hardware capable of sending IR commands; 

an integrated graphical display; 

integrated software programmed to present a set of 
screens on the graphical display for navigating through 
available options; 

at least one port for communicating with an outside data 
source; 

a memory; and 

at least two physical buttons; 

wherein the integrated software is further programmed to 
identify a particular user of the remote control by 
displaying on the graphical display an icon or image 
associated with the particular user. 
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